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Maximal index automorphisms of free groups with 
no attracting fixed points on the boundary 
are Dehn twists 

Armando Martino 

Abstract In this paper we define a quantity called the rank of an outer 
automorphism of a free group which is the same as the index introduced 
in [7] without the count of fixed points on the boundary. We proceed to 
analyze outer automorphisms of maximal rank and obtain results analogous 
to those in [4]. We also deduce that all such outer automorphisms can be 
represented by Dehn twists, thus proving the converse to a result in [3], and 
indicate a solution to the conjugacy problem when such automorphisms are 
given in terms of images of a basis, thus providing a moderate extension to 
the main theorem of [3] by somewhat different methods. 

AMS Classification 20E05, 20E36 
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1 Introduction 

The celebrated result of [2] showed that for any automorphism of a finitely 
generated free group the rank of its fixed subgroup is at most that of the rank 
of the ambient free group. In [5] a detailed analysis and description was obtained 
for those automorphisms whose fixed subgroup has the largest possible rank - 
maximal rank automorphisms. 

The paper of [3] introduced a class of automorphisms called Dehn Twists (de- 
fined below) and showed that these have maximal index with no attracting fixed 
points on the boundary. In that work, the conjugacy problem for Dehn Twists 
is also solved and it is shown, by using the results of [5], that a maximal rank 
automorphism can be represented by a Dehn Twist. 

In this paper we define a notion of rank for outer automorphisms which gen- 
eralises the notion of rank of the fixed subgroup. (In fact this notion of rank 
is implicit in [2].) Alternatively, this rank can be thought of as the index of 
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an outer automorphism, as described in [7], but with the change that the fixed 
points on the boundary are not counted. 

We then proceed to generalise the results of [5] to the class of maximal rank 
outer automorphisms and obtain a normal form similar to the one obtained 
there. Moreover, we show that any such outer automorphism can be realised as 
a Dehn Twist. Thus the class of Dehn Twists and that of maximal rank outer 
automorphisms coincide. 

In [9] the normal form of [5] is used to provide a solution to the conjugacy 
problem for maximal rank automorphisms. We also observe that since the 
normal form we obtain is so similar to that in [5], it is possible to use the 
same proof to provide a solution to the conjugacy problem for Dehn Twists 
by entirely different means to those of [3]. Moreover, this solution would take 
as input data a Dehn Twist described purely in terms of its action on a basis 
rather than by graph of groups data as required in [3] hence giving an extension 
to that result. 

2 Preliminaries 

2.1 Outer automorphisms and index 

Throughout F n shall denote the free group of rank n. Here the rank is the 
minimal number of generators and is the same as the number of free generators. 
The rank of a subgroup, H , of F n is the least cardinality of the generating sets 
of the subgroup and is denoted r(H). 

Aut(F n ) is the group of automorphisms of F n . Inn(F n ) will be the subgroup 
of inner automorphisms and Out(F n ) = Aut{F n ) / Inn(F n ) the group of outer 
automorphisms of F n . We use the notation 7 9 to denote conjugation by g. 
Thus wjg = g~ 1 wg for all w G F n . (We will write automorphisms on the right, 
although the topological representatives below will be written on the left). 

We shall think of an outer automorphism of F n as a coset, and as such it 
will be a set of automorphisms any two of which differ by conjugation by some 
element. 

A similarity class in $ will be an equivalence class under the equivalence rela- 
tion, (f> ~ ip if and only if <j) = 7 s ^7 9 -i for some g E F n . Note that we think of 
this as an equivalence relation on <& where two equivalent automorphisms are 
called similar. 
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It is important to note that, unlike the situation with matrices, two automor- 
phisms are not called similar if they are conjugate. They are only similar if 
and only if they are conjugate by an inner automorphism. This follows the 
terminology of [7] . In [3] , the same concept is denoted by the phrase conjugate 
up to inner automorphisms and some authors use instead the term isogredience. 

The fixed subgroup of an automorphism <p € Aut(F n ) is the subgroup Fix (f> = 
{w € F n : wcp = w} and by [2] has rank at most n. Given an outer auto- 
morphism <E>, one can find (infinitely many) representatives <pi of the distinct 
similarity classes in $. It is clear that similar automorphisms have fixed sub- 
groups of the same rank thus the following (possibly infinite) quantity is well 
defined. 

Definition 2.1 The rank of an outer automorphism <5 of F n is the sum 



where the sum is taken over a set {4>i\ of representatives, one for each similarity 
class of $. 

The following Theorem is proved in [8] and is in fact equivalent to the main 
Theorem of [2]. 

Theorem 2.2 [8] For every $ <E Out(F n ), r($) < n. 

An immediate observation is that only finitely many of the fa have fixed sub- 
group of rank greater than one. 

This observation leads us to the following definition. 

Definition 2.3 For any $ € Out(F n ), let s(3>) denote the number of distinct 
similarity classes in $ which have fixed subgroup of rank at least 2 . By Theorem 
2.2, this quantity is always finite. 

In [7] the index of an outer automorphism i(3>) is defined. This has the same 
definition as the rank of <I> defined above with the addition of a term which 
counts attracting fixed points on the boundary of F n . Thus it is clear that 
r($) < i($). In [7] it is shown that i(<E>) < n for every $ <G Out(F n ). 1 
Also in [3] it is shown that if $ is represented by a Dehn twist automorphism 

fact the index described in [7] is one less than the one we refer to. The change 
is merely to emphasise the parallels between Theorems in Out(F n ) and Aut(F n ) . 
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(definitions below), then i(<J>) = n and <3? has no attracting points on the 
boundary. This is the same as saying that r(3>) = n. In this paper we prove 
the converse of this result. Namely that if r(<E>) = n then can be represented 
by a Dehn twist automorphism. 

In fact the main Theorem of [2], proved a conjecture of Scott's who formulated 
it after proving the following: 

Theorem 2.4 [6] If an automorphism <fi of Aut(F n ) has finite order, then 
Fix cf) is a free factor of F n . 

Corollary 2.5 For any <fi £ Aut(F n ) and any integer m > 1, Fix (j) is a free 
factor of Fix <p m . 

Proof By Theorem 2.2, Fix (f) m is of finite rank and as 4> and (fi m commute, 
<j) leaves Fix (fr m invariant. Since it acts as a finite order automorphism, the 
result follows from Theorem 2.4. □ 

This will have important consequences for us. The construction used in the 
proof of the following Proposition is due to G. Levitt. 

Lemma 2.6 Consider an outer automorphism $ € Out(F n ) of finite order. If 
<I> is not the identity then r(<3?) < n. 

Proof We may find a maximal set of automorphisms 0i, ... $ in distinct 

similarity classes all of whose fixed subgroups have rank at least 2 . (Note that 
k = s($).) Thus r($) = 1 + Ej=i( r ( Fix <f>j) ~ !)■ 

Also, we know that $ has order m in Out(F n ) for some m > 2. Hence every 
automorphism in <3? m is inner and by Theorem 2.4 this implies that (j)j m = 1 £ 
Aut{F n ) for all 1 < j < k. 

Pick a basis x\, . . . ,x n for F n and find §2, ■ ■ ■ ,9k so that (f)jj gj = (j>\. (By 
definition the <j)j differ by inner automorphisms.) 

Consider a free group of rank n + k — 1, F, with basis x\, . . . , x n , . . . , x n+ k-i 
where we identify F n with (x±, . . . ,x n ). Define an automorphism <fi of F by 
setting (p\ Fn = <pi and (x n+j -i)4> = x n+j -igj, 2<j<k. 

First note that 4> cannot fix certain words. <j) cannot fix any word of the form 
XjWXj/^ 1 for j ^ j' > n + 1 and w G F n , for if it did then this would imply 
that 

gjiw^igj- 1 = w 

w~ 1 {w)4)j = gj/gf 1 , since (f>jj gj = <$> x . 
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This last equality is not possible since it would mean that 

TuTVjT™ = (f>jl{w-^)<p jW 

and by construction these automorphisms are not similar. 

Also, (j) cannot fix any word of the form XjW, for j > n + 1 and w £ F n for 
then we get gj = w(w~ 1 )(j). This would imply the similarity of 4>\ and <f>j as 
Iw^ilw' 1 = again reaching a contradiction. 

We are now in a position to determine Fix (f>. 
Claim 

Fix <p = Fix 0i *^ =2 x n+J _i(Fix ^)x n+ j_i -1 . 

It is clear that the term on the right hand side is a subgroup of Fix <fi . Consider 
a word w F n , of shortest length fixed by <p and not of the form given above. 
We can write such a word as, 

W Xj 1 ei WlXj 2 €2 W2 ■ ■ ■ Xj p ep W p 

where each ji > n + 1, 6j = ±1 and Wi € F n and p > 1. We proceed by a 
simple cancellation argument. 

If e\ = — 1 it is easy to see that xj-^wq^ 1 must be fixed, giving a contradiction 
as above. Hence e± = 1 and since this implies that u>o is fixed we may assume 
that wo = 1 by minimality of the length of w . 

Now, if e = 1 and either p = 1 or e2 = 1, then Xj^i must be fixed, again a 
contradiction. Thus p must be at least 2, ei = 1 and e 2 = — 1 leading us to 
the conclusion that fixed. The only way that (f> can fix a word of 

this type is if j\ = ji and w\ £ Fix 0^ . This contradicts the minimality of w 
and proves the claim. 

Hence, 

k 

r(Fix 4>) = ^ r ( Fix 4>j) = r ($) + k - 1. 
i=i 

However, each has order m and since <£j = <^i7 ff -i , this implies that 

(s- 1 ^rv i )^r 2 ---<7- 1 = i- 
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Taking inverses we get that gj(gj)4>i(gj)4>\ . . . (gj)^™^ 1 = 1 and hence that 
Xj(j) m = xj. Since <^ m |_F„ = 4>\ = 1 we know that (f) m = 1. Clearly, <j) ^ 1 and 
so by Theorem 2.4, r(Fix 4>) < r(F) = n+k-1. Thus r($) = r(Fix (f))-k+l < 
n , completing the proof of the Lemma. □ 

Consider an outer automorphism <J> . Clearly if (j), ip € are similar, then 
(j} m ,t(j m 6 <3? m will also be similar. The converse on the other hand need not 
be true. However, if we concentrate on those similarity classes with non-trivial 
fixed subgroup, the next proposition tells us that the only way these similarity 
classes can get 'collapsed' in a power is if the rank of the outer automorphism 
increases. 

Proposition 2.7 Consider G Out(F n ) and let 4>, ijj € <3? be non-similar 
automorphisms each with non-trivial fixed subgroup. If for some integer m, 
(j) m and ip m are similar, then r(<E>) < r(<& m ) . 

Proof We first choose a collection of automorphisms 0i, $ in distinct 

similarity classes each with non-trivial subgroup so that each of <fi and ip is 
similar to some automorphism on the list. Additionally, we enlarge the list so 
that any automorphism in <E> which has fixed subgroup of rank at least 2 is 
similar to one on the list. 

After a rearrangement we may find integers ki,...,k s so that §™ is simi- 
lar to (j)™ if and only if k p < i,j < k p+ \ for some 1 < k p < k s . In other 
words, we list representatives of similarity classes for $ so that only consecutive 
similarity classes get collapsed in $ m . As a consequence, the automorphisms 
§k x , 4>™ 2 , 4>™ a form a set of representatives of distinct similarity classes of 
$ m with non-trivial fixed subgroup. Thus 

s 

r(*™) > 1 + j>(Fix C p )-1)- 
P =i 

By changing representatives for similarity classes in <I> we may in fact assume 
that 4>T = ¥j l whenever k v <i,j < k p+ \. Thus if k p < j < k p+ i, then Fix <pj 
is a subgroup of Fix (frj- = Fix 0™ := H p . In fact, as 4>j and 0™ commute, 
H p is invariant under <j)j which restricts to a finite order automorphism on this 
subgroup. 

Also, if we write 4>j = <t>k p lg then, 

*3 ~ \g)^- 2 ...(g)<t> kp g 
J.m_ . 

~ ^{g)^ p -\9)^ p - 2 -(9)^ p 9 
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and hence {g)<l>™ 1 (9) ( t ) T p 2 ■ ■ ■ {g)4>k p g = 1- Looking at the image of this ele- 
ment under fa we note that (g)4>™ g~ l = 1. In other words, g £ Fix fa£ = H p 
and the two automorphisms in question induce the same outer automorphism 
when restricted to H p . 

Note that if g were to be fixed by fa v then this would imply that that g = 1 
and so that fa = fa p ■ Hence if k p+ \ — k p > 1 then H p = Fix fa} is strictly 
larger than Fix fa and in particular, the outer automorphism induced by (frkp 
on H p cannot be the identity. 

Thus let ^ p be the outer automorphism induced by the restriction of fa p to H p . 
By the comments above, we know that \J/ p is a finite order outer automorphism 
and that, 

kp+i— l 

r(%)>l+ (KFix^-)-l). 

j=k p 

Note that r(^ p ) is always bounded above by r(H p ) by Theorem 2.2, however 
if the number of terms in the sum on the right hand side is greater than one 
we know that *& p ^ 1 and hence we may apply Lemma 2.6 to deduce that 
r(*S> p ) < r(H p ) . In fact, our hypothesis guarantees that for some p this will be 
the case, and so 

l + I>(*p)-l)<l + E(Ktf P )-l). 

p=i i=i 

As the left hand side is bounded below by r(3>) and the right hand side is 
bounded above by r($ m ) this concludes the proof. □ 

Recall that w G F n is <p periodic if (w)(f) m = w for some 

Corollary 2.8 Let $ 6 Out(F n ) have maximal rank and suppose that w € F n 
is 4> periodic for some G with non-trivial fixed subgroup. Then w € Fix 0. 

Proof Choose an integer m such that w(j} m = w. Since r(<J>) = n we deduce, 
by Proposition 2.7, that if <j>, ip G $ have non-trivial fixed subgroup, then they 
are similar if and only if <ft m , tp m € <3? m ' are similar. In particular this means that 
if r(Fix (f>) < r(Fix (p m ) then r(3>) < r($ m ), a contradiction. But by Corollary 
2.5, if r(Fix (f>) = r(Fix <ft m ) then in fact Fix (j) = Fix m . This completes the 
proof. □ 
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3 Relative train track maps 

We use the relative train track maps of Bestvina and Handel to analyze an 
outer automorphism. We recap some of the properties of relative train track 
maps. 

A relative train track map is a self homotopy equivalence, / , of a graph G which 
maps vertices to vertices and edges to paths. Such an / is called a topological 
representative. 

Note that if the image /(e) of an edge e is not homotopic to a trivial path 
relative endpoints then we may replace / with a homotopically equivalent map 
that is locally injective on the interior of e. The process of doing this for each 
edge is called tightening f . Relative train track maps are always tightened. 

The graph G has no valence one vertices and is maximally filtered in the sense 
that it has subgraphs 

= G c Gi c ■ ■ ■ c G m = G, 

where each Gi is an /-invariant subgraph and if f(G r ) % G r -\ then there is no 
/-invariant subgraph strictly between G>_i and G r . The closure of G r \G r —i 
is denoted by H r and is called the r th stratum. 

On labelling the edges of the r th stratum, e\,... , e&, one can form the r th 
transition matrix, M r , whose entry is the number of times that that 

/(ej) crosses (in either direction). 

If f(G r ) C G r -\ then M r is a zero matrix and H r is called a zero stratum. If 
M r is a permutation matrix, then H r is called a level stratum. Otherwise H r 
is called an exponential stratum. 

Remark 3.1 In order for f,G to be a relative train track map further con- 
ditions need to be imposed on the exponential strata. However, we shall only 
need to consider, by Proposition 4.1, those maps with no exponential strata, in 
which case relative train track maps are precisely those topological representa- 
tives which are tight and maximally filtered. 

A Nielsen path (NP) is a path in G which is fixed by / up to homotopy relative 
endpoints. An indivisible Nielsen path (INP) is an NP which cannot be written 
(non-trivially) as the concatenation of NP's. In [2] it is shown that every NP 
can be written uniquely CIS db product of INP's. 

A path in G is said to have height r if it is contained in G r but not £r r -i • In [2] 
it is shown that there is at most one INP of height r for each r . Note that this 
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uses the property known as stability in [2]. We shall also assume throughout 
that isolated fixed points of / are in fact vertices of G. The following remarks 
are part of the analysis of [2] and in particular, the proof of Proposition 6.3. 

Remark 3.2 ([2], pp48-49) If there is an INP, p, of height r , then H r cannot 
be a zero stratum. Furthermore, if H r is a level stratum then it must consist 
of a single edge E, with f(E) = Eu for some path u in G r -±. In that case, p 
must be of the form E(3 or E(3E for some path (3 in G r _i . 

A graph S along with a map p: £ — ► G may then be constructed such that, 

(1) p maps vertices of S to vertices of G fixed by /, 

(2) p maps edges of S to INPs, and 

(3) every NP in G is the image (under p) of a path in S. 

In fact, £ is constructed so that its vertices can be regarded as being precisely 
those vertices of G which are fixed by /. Also, following [2], one may define 
certain subgraphs of £ . 

Definition 3.3 Let £ r to be the (not necessarily connected) maximal sub- 
graph of £ which maps to G T under p. 

Definition 3.4 For every vertex v of G, which is fixed by /, is the com- 
ponent of £ containing v. 

Remark 3.5 ([2], p48) The graph £ r differs from £ r _i by at most a single 
edge when there is an INP of height r . 

For a connected graph, G, define the rank of G, r(G) to be the rank of tti{G) . 
For an arbitrary graph define the reduced rank to be 

7(G) = l + Yl m ax(0, r(G k ) - 1) 
where the sum ranges over the components of G. 
It is shown in [2], p48, that 

(1) r(S) < r(G) = r(G) and, 

(2) r(£ r )<r(G r ). 

By Remark 3.5 above we also have that 

(3) r(E r+ i) <r(E r ) + l. 
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Remark 3.6 ([2], p48) Note that if r(£ r+ i) = f(S r ) + l then there is an edge 
in £ (which maps to an INP, p r of height r in G) and which has endpoints in 
(possibly one) non-contractible components of E r . Thus p r also has endpoints 
in (possibly one) non-contractible components of G r and so r(G r+ {) > f(G r ) + 
1. 



Representing automorphisms 



Let / be a relative train track map on the graph G. Suppose that v is a vertex 
of G and ri a path in G from f(v) to v. Then 7Ti(f,fi) will denote the induced 
isomorphism of 7Ti(G, v) that sends the closed path a at u to p,f(a)fi. Here 
denotes the inverse path to fx. Write ivi(f,v) in the case where v is fixed by / 
and n is the trivial path at v. 

Let R n denote the graph with one vertex, * , and n edges, called the rose and 
identify F n with ni(R n , *). We say that an outer automorphism $ G Out(F n ) 
is represented by the relative train track map / on G if there is a homotopy 
equivalence, r : R n — ► G such that the following diagram commutes up to free 
homotopy: 

Rn^+G 




Note that we are identifying $ with a self homotopy equivalence of Rn • 

Given a representation of $ as above, we say that 4> G $ is point represented 
at f (by /, G, r) if -u is fixed by / and there is a path, a, from r(*) to v 
such that the following diagram commutes, 

7ri(r,a) 



7Tl {Rn 



■7Tl(G» 



7Tl(T,a) 

7Tl(i?„,*) ^7Ti(G,u) 

where 7Ti(r, a) is induced by the map which sends the path g C R n to ar(g)a. 

It is shown in [2] that every outer automorphism, $ , is represented by a relative 
train track map, /, G, r. Furthermore we have: 

Proposition 3.7 (Corollary 2.2, [2]) If an (ordinary) automorphism, (f> € $ 
has fixed subgroup of rank at least 2, then this automorphism will be point 
represented by (/, G, r) . 
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Note that if <j) is point represented at v, then any automorphism similar to 
will also be point represented at v. Also, if there is a Nielsen path between the 
vertices v and v' , then <f> will be point represented at v' . Conversely, suppose 
that 4> is point represented at both v and v' , with paths a, a' from r(*) to 
v,v' respectively, then aa' is a Nielsen path from v to v' . 

Remark 3.8 Hence, bringing this together, if ft € 3> are both point repre- 
sented at v and v' respectively (by f,G,r) then they are similar if and only 
if there is a Nielsen path from v to v' . In the case where all NP's are closed, 
each fixed vertex will determine a distinct similarity class of . 

If $ is represented by /, G, r and G is point represented at v then (Def- 
inition 3.4) r(Y, v ) = r(Fix <p) and f(S) = r($). In fact the map p: £ — > G 
induces isomorphisms from vri(S 1 ') to Fix whenever <p is point represented 
at v. 

In the case where $ has maximal rank (and is represented by f,G,r) then 
f(S) = r(G). By Remarks 3.5 and 3.6 we deduce that: 

Lemma 3.9 If has maximal rank then, 

f(Sfe) = r(G fc ) for all k. 

4 Good Representatives 

From now on $ will be a maximal rank outer automorphism of F n . We shall 
show in this section that every such outer automorphism has a relative train 
track map representative with good properties. The first step is to observe: 

Proposition 4.1 (Prop 4, [5]) If has maximal rank then any relative train 
track map representative has no exponential strata. 

In fact the Proposition in [5] relates to automorphisms (not outer!) of F n 
with fixed subgroup of rank n. However, the only hypothesis used is that 
f(Efc) = r(Gk) for all k, and hence the proof there applies equally in our 
situation. 

In order to find a good relative train track map representative, we need to 
perform a certain operation as follows. Suppose that /: G — > G is a relative 
train track map and that = {E}, where f(E) = Eu, and u is a path in 
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Gk-i- For any path a in G^-i with initial vertex the same as the terminal 
vertex of E we can define a new graph G' by replacing E with an edge E' with 
the same initial vertex as v and whose terminal vertex is the same as that of a . 
Every edge of G — {E} is naturally identified with that of G' — {E'}. We can 
then define /' : G' — > G' so as to agree with / (up to homotopy) on G — {E} , 
and so that f'(E') ~ f(E)auf(a) and /' is tight. The homotopy equivalence 
p: G — > G' which is the 'identity' on G — {E} and sends E to E'a gives the 
following commuting diagram. 




Moreover, if we set Gj = p(Gj) then /' is a relative train track map with 
stratum H'- of the same type (zero, level or exponential) as Hj . This operation 
is called sliding in [1] and a proof of the above statements is contained in [1], 
Lemma 5.4.1 and is a slight variation of the construction that appears in [5], 
Proposition 3. 

Our first application of sliding is in fact precisely analogous to that in [5] . 

Proposition 4.2 Let G Out{F n ) , n > 2, have maximal rank. Then there is 
a relative train track map representative, f, G, for $ in which every indivisible 
Nielsen path, p^ , of height k is either of the form E(3E for some path (3 in 
Gk-\ or pk = E and E is a closed loop. 

Proof By Proposition 4.1 and Remark 3.2, we only need to consider the case 
where a stratum Hk consists of a single edge E , f(E) = Eu, and Ea is an INP, 
for some u, a subpaths in G^-i- (This requires subdivision at isolated fixed 
points). Sliding E along a we obtain a relative train track map representative 
/', G' , where f(E') = E' . If we do this in all possible cases and then collapse any 
fixed edges which are not loops, we end up deleting some strata, but otherwise 
still with a relative train track map representative. It is clear that for this map, 
every INP is of one of the above types. □ 

An examination of the above proof gives a way of starting from a representative 
of $ and getting another where we have better control of INP's. We want to 
have an easy way of insuring this condition. For that we need the following: 

Definition 4.3 Let f,G represent the maximal rank outer automorphism $. 
We say that /, G has minimal complexity if G has the minimal number of 



Algebraic & Qeometric Topology, Volume 2 (2002) 



Maximal index automorphisms 



909 



vertices amongst all representatives of $ subject to the restriction that /, G 
satisfies the conclusion to Proposition 4.2 and that all isolated fixed points are 
vertices. 

Lemma 4.4 Any representative f,G of Q of minimal complexity has the 
minimal number of vertices amongst all representatives of with vertices at 
isolated fixed points. 

Proof An examination of the proof to Proposition 4.2 shows that if a repre- 
sentative with vertices at isolated fixed points does not satisfy the proposition 
then we perform a sliding operation followed by the collapse of an invariant for- 
est. Since this cannot increase the number of vertices of the underlying graph 
and cannot introduce any new isolated fixed points, we are done. □ 

We shall henceforth assume that our maximal rank outer automorphism is 
represented by a relative train track map which satisfies the conclusions of 
Proposition 4.2. 

Remark 4.5 Suppose that G has exactly r strata, so that G = G r . Then 
since G has no valence one vertices, rG r > rG T -\ . Thus by Lemma 3.9, there 
is an INP of height r. Hence there is a single edge E so that H r = {E} and 
f(E) = Eu with u a path in GV-i, possibly trivial. Denote the initial vertex 
of E by v and the terminal vertex by w. Let C\ denote the component of 
G r _i containing v and C2 the component containing w. Thus if E is non- 
separating, C\ = C2. Clearly, /(Cj) C C{ and in fact it must restrict to a 
homotopy equivalence in each case. 

Using this notation we can show: 

Proposition 4.6 Let f,G be a representative of <3? G Out(F n ) (n > 2 ) of 
minimal complexity. Then the following hold: 

(1) If E is separating in G then C2 has rank at least 2. 

(2) If C\ is a rank 1 graph, then it consists of a single closed fixed edge and 
a single vertex. 

Proof We start with property 1 where we need to show that if E is separating 
then C2 must have rank at least 2. If this is not the case then C2 will have 
rank one and since there is an INP E/3E, f\EuC 2 i s homotopic to the identity 
map relative to v. Thus there is a map /' on G which also represents $ and 
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which is the identity on E U C2 ( /' agrees with / on C\ ) . It is clear that /' 
is also a relative train track map (with the same strata as /) and has vertices 
at isolated fixed points. Note that E is a separating edge fixed by /'. By 
collapsing E we contradict Lemma 4.4. 

To prove 2, note that since rS r > rY> r _i, £J!-i mus t have rank at least 1. 
Hence there is always a closed Nielsen path at the vertex v contained in C\ . So 
if the rank of C\ is 1 then we can apply the argument as above to show that, 
without loss of generality, / restricts to the identity on C\ . The only way that 
this does not contradict the minimal complexity hypothesis is if C\ consists of 
a single fixed edge. □ 

As an immediate corollary we get: 

Corollary 4.7 Let <E> € Out(F2) have maximal rank and f, G be any relative 
train track map representative of minimal complexity. Then exactly one vertex 
v and two edges, a, b, where without loss of generality /(a) ~ a and f(b) ~ ba r 
for some integer r . 

Proposition 4.8 Let f,G be a relative train track map representing a maxi- 
mal rank outer automorphism. Suppose that C is a component of some G^ with 
f{C) > 1 . Then f(C) C C and f induces a maximal rank outer automorphism 
on C. 

Proof The proof is by induction on r(G). If r{G) = 1 then C can only be 
equal to G and we are done. 

Consider the edge E as in Remark 4.5. If E is a separating edge, then since 
it is the content of the highest stratum, we can write S r _i as a disjoint union 
of graphs, S 1 and S 2 , where C Cj. In other words, contains all the 

edges of S r _i that map to INP's of Cj. It is clear by the properties of S that 
the rank of the outer automorphism induced by f\c { is exactly rS* and hence 
by Theorem 2.2, ?S* < rCj. However, 

rG = rC l +rC 2 + l 
> ?E 1 + rS 2 + l 
= F2 r _i + 1 
= F2 
= rG. 

The upshot of this is that each f\c i induces a maximal rank outer automor- 
phism on 7Ti(Cj). A similar argument applies when E is non-separating, where 
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G — {E} = G r -i = C\ = C2 to get that f\c 1 induces a maximal rank outer 
automorphism. 

Now each C\ inherits a filtration from G, namely, C, U G m is an invariant 
subgraph of Cj . Thus as any component C of some Gk is actually a component 
of Ci n Gk (except G itself) we may use our inductive hypothesis to finish the 
proof. □ 

Theorem 4.9 Let f,G be a relative train track map of minimal complexity, 
with r(G) > 2, representing a maximal rank outer automorphism. Suppose 
that for some closed path a, f(a) ~ flari. Then there is a path r\ in G such 
that 

(1) [fjarj] £ wi(G,v). 

(2) 7Ti(/, v) has fixed subgroup of rank at least 2. 

Proof Let G = G r and use the notation of Remark 4.5. Note that whether or 
not E is separating, by Proposition 4.2, £ differs from £ r _i by a single closed 
loop at the vertex v. Since rS r > r£ r _i, we must have that r(E"_ 1 ) > 1 and 
r(£ w )>2. 

We will first prove the Theorem in the case where ot is not freely homotopic to 
a path in G r _i . By possibly replacing a with its inverse, we may choose an rj 
so that fjar] is a path that starts with E and does not end with E . Since this 
is a closed path at v and r(T, v ) > 2, it will suffice to show that this path is 
fixed up to homotopy. 

Notice that in fact every positive / iterate of this path also begins with E 
and does not end with E. Our key observation here is that, with respect to 
some basis, this path and its iterates are cyclically reduced words. If E is non- 
separating then choose any maximal tree that does not include E . The induced 
basis certainly ensures that each [f k (fjari)] are cyclically reduced. 

If, on the other hand, E is separating then note that / induces automorphisms 
of H = tti(Ci,v) and on K = 7Ti(C2U {E},v). If we choose a basis for tti(G,v) 
that extends bases for H and K it is then easy to see that [fjarj] starts with a 
non-trivial word from K and ends with a non-trivial word from H and the same 
will be true of all its iterates. Hence in either case [fjarj] and all its iterates are 
cyclically reduced elements of tti(G, v). But since any element of a free group 
has only finitely cyclically reduced conjugates, this means that [fjarj] is 7Ti(/, v) 
periodic and hence by Corollary 2.8, fixed. 
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This leaves us with the case where a is freely homotopic to a path in G r -\ = 
C\ U C2 • Consider first the case where a is freely homotopic to a path in Cj 
and r(Ci) = 1. By Proposition 4.6, Cj = Ci which consists of a fixed edge 
loop. Thus we may choose 77 so that ryar/ is fact a power of the fixed edge loop 
and we are done in this case. 

If on the other hand a C C 2 then E must be a separating edge and the INP of 
height r is of the form E/3E . We can then choose rj so that fjarj is a loop at 
v homotopic to a power of that INP. (Recall we are assuming that r(C2) = 1.) 
Again we would be done. 

We finish the argument by induction on r(G) . If v[G) = 2 then either a is not 
freely homotopic to a path in G r _i or a C Cj where r(Cj) = 1. The arguments 
above deal with each situation. 

So suppose that the proposition is true for all rank less than r(G) and at 
least 2. Again, if a is not freely homotopic to a path in G r -\ we are done. 
Hence, without loss of generality a C Cj and we can assume that r(Cj) > 2. 
By Proposition 4.8 we may apply our induction hypothesis to complete the 
proof. □ 

As an immediate consequence of the above we get: 

Corollary 4.10 Let <E> € Out(F n ), n > 2, be a maximal rank outer automor- 
phism fixing a conjugacy class. Then there is a (j) G <3? with fixed subgroup of 
rank at least 2 fixing an element of that conjugacy class. 

We are now ready to show that a maximal rank outer automorphism of F n has 
a representative with very good properties, analagous to those in [5] . 

Theorem 4.11 Let $ be a maximal rank outer automorphism of F n . Then 
there is a relative train track map representative of minimal complexity for $ , 
(/, G) , such that, 

(1) every vertex of G is fixed, 

(2) for every vertex, v of G, iTi(f,v) has fixed subgroup of rank at least 2, 
and 

(3) (up to orientation) every edge E of G satisfies, f(E) = E(5, where (5 is 
a closed Nielsen path contained in strata lower than E . 
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Proof The case n = 2 follows from Corollary 4.7, so we proceed by induction. 
Our hypothesis will actually be that given any representative of of minimal 
complexity, a sequence of sliding operations will transform the representative 
into one which satisfies the conclusion of the Theorem. 

Start with a relative train track map representative /, G of minimal complexity 
and top edge E as in Remark 4.5 so that the initial vertex of E is v and the 
terminal vertex is w. We already know that the fixed subgroup of iri(f,v) has 
rank at least 2 and that v is a fixed vertex. In fact, we make make the following 
claim: 

Claim After a sliding operation we obtain a relative train track map repre- 
sentative of minimal complexity with the following properties (notation from 
Remark 4.5): 

(1) Either (i) E is a fixed edge loop, or (ii) the INP of height r is Ef3E , where 
(3 is a closed Nielsen path at w . 

(2) In case (ii), f(E) = E(3 k for some k. 

(3) w is a fixed vertex and the fixed subgroup of iti(f, w) has rank at least 2. 

Proof of claim The claim is immediate if E is a fixed edge loop. It also 
follows immediately from Proposition 4.6 if E is non-separating and r(C\) = 1. 
Therefore (by another application of 4.6) we may assume that the INP of height 
r is E(3E. So (3 is a loop at w where (3 C d with r(Ci) > 2. Also (as in 
Remark 4.5), f(E) = Eu where u is a path in C{ (the same component of G r _i 
as (3). By Proposition 4.8, there exists a path rj C d C G r _i such that f)(3r] is 
a closed Nielsen path at some vertex w' and that TTi(f',w') has fixed subgroup 
of rank at least 2. If we now slide E along ry, we get a new representative with 
an edge E' , such that f'(E') = E'[fjuf(rj)]. The new INP of height r will be 
E'[f}Prj\E'. 

However, 

f(j3) ~ u(3u 

and 

/ (77/377) ~ fj(3n. 

Hence fjuf(rf) commutes with fj(3r] and since these are both closed paths we 
deduce that the former is a power of the latter. (Note (3 cannot be a proper 
power. ) Hence, f'(E') = E'(3' k where 0' is a closed Nielsen path at the vertex 
w' . Moreover w' is fixed by /', 7Ti(/', w') has fixed subgroup of rank at least 2. 
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Thus /' is a map with the required properties and since no new vertices were 
introduced, we may assume that the new representative has minimal complexity. 
This concludes the proof of the claim. □ 

The idea now is to use the induction hypothesis on C\ and C2. (Sliding an 
edge in Cj is equivalent to sliding the same edge in G). However it may be that 
Ci,C2 contain valence one vertices (these are not valence one in G but in the 
Ci ) so we need to consider how this can arise. We proceed with a representative 
of which satisfies the conditions in the claim above. 

Consider first the case where E is separating. Note that since the INP of height 
r is a closed path at v, this implies that T, w = and hence that the fixed 

subgroup of ni(f,w) is contained in ir\{C2,w) . Since distinct INP's start with 
distinct edges, we know that w has valence at least 2 in C%. Hence C2 has no 
valence 1 vertices and applying the induction hypothesis we can assume that 
the Theorem holds for every edge and vertex of C2. (Note here that f\c 2 is 
a relative train track map and if it were not of minimal complexity we could 
replace f\c 2 ^2 with some f',C via a homotopy relative w. This is clearly 
not possible since it would contradict the minimal complexity of f,G). 

To continue, if r(C\) = 1 we are done. Also, if every vertex of C\ has valence at 
least 2 , then we are done since again we could apply the induction hypothesis 
to/ld.Ci. 

So there is only something to prove if r{C\) > 2 and C\ has a valence one 
vertex. Clearly, v is the only vertex of C\ which can have valence 1. Let e 
be the edge of C\ whose initial vertex is v. Since there is a closed INP at the 
vertex v contained in C\ , we deduce that the INP is of the form eae . Just as 
in the proof of the claim above, after sliding e, we can assume that /(e) = ea m 
for some m and that a is a closed Nielsen path. Note that the terminal vertex 
of e must have valence at least 3, since otherwise we could slide e along an 
edge to produce a valence 1 vertex in G, contradicting the property of minimal 
complexity. (This would also follow from the proof of the claim.) Also, both 
endpoints of e are fixed and that the corresponding fixed subgroups have rank 
at least 2 in n\(G). 

Hence f(C — {e}) CC - {e} and every vertex has valence at least 2. Thus we 
may apply our induction hypothesis to C — {e} . The Theorem is then is then 
proved in this case, since every edge of G is either E, e or in C\ U C2 , and every 
vertex is incident to one of these. 

The same argument will apply when E is non-separating, since we may assume 
that r(Ci) > 2 as the case n = 2 has already been dealt with. □ 
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Let us call a representative of $ which satisfies the conclusions to Theorem 
4.11 a good representative. One immediate observation is that since every NP 
is closed, by Remark 3.8, the number of vertices of a good representative is 
precisely s($>), the number of similarity classes with fixed subgroup at least 2. 
Thus if we start with an automorphism <\> G Aut(F n ) which has fixed subgroup 
of rank n, then a good representative of the outer automorphism induced by 
4> will have exactly one vertex. Moreover, </> will be point represented at that 
vertex and we recover the main Theorem of [5] . Methods used to analyze such 
automorphisms naturally generalise to our situation. Hence the argument used 
in [9] to solve the conjugacy problem for automorphisms with maximal fixed 
subgroup can be applied with almost no changes to get: 

Theorem 4.12 Given two outer automorphisms of maximal rank, <£, ^ G 
Out{F n ) in terms of images of a basis it is possible to decide whether they are 
conjugate. 

We shall show below, that any outer automorphism of maximal rank can in 
fact be represented by a Dehn twist and the conjugacy problem has been solved 
for these in [3]. Thus the only advance made is an explicit algorithm when the 
automorphisms are given in terms of images on a basis. 

5 Graphs of groups and Dehn twists 

We shall now show that any outer automorphism of F n of maximal rank is 
represented by a Dehn Twist. We give a brief recap of the objects involved, 
taken from [3]. 

Definition 5.1 A graph of groups is given by 

G = {T(G), {G v } eeE (g), {fe}eeE(g)} 
T(G) is a finite connected graph, 
V(G) is the vertex set of T(G), 
E(G) is the (oriented) edge set of T(G), 
G v is the vertex group at v G V(G), 
G e is the edge group at e G E(G) and, 

m e : G e — > G T ( e ) is a monomorphism. (Here r(e) denotes the terminal vertex 
of e and hence re the initial vertex.) 
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The path group 11(G) is the free product of the free group on the set {t e : e <G 
E(Q)} with the groups G v , subject to the relations, 

(i) te = t e ~ l and 

(ii) t e m e (a)t e ~ l = m g (a) £ G rS for all a £ G e ,e G E(Q). 
Every element of IT(^) is given by a word 

W = r ti . . . t q r q , 

where each t j = i ei and rj is an element of the free product of the G v . Such 
a word is called a loop at the vertex v if ro,r q £ G v , r(e~i) = re q = v and 
rej = rej+i with € Gy( e .) for all i (taking subscripts modulo g). 

The set of loops at v forms a subgroup of II(<7) denoted, iri(Q,v) and called 
the fundamental group of Q at v . 

A Dehn twist, Don^, with twistors z e is an automorphism of H(Q) such that, 

V(t e ) = t e m e (z e ) 

where z e is in the centre of G e and z s = ZfT 1 . Extend D to the whole of IT(^) 
by setting it equal to the identity on each vertex group. Note that specifying 
the twistors z e is sufficient to define D. 

Since D preserves incidence relations, it restricts to an automorphism D v on 
-K\(G) for any v G V(Q). 

We shall say that an outer automorphism $ € Out(F n ) is represented by a Dehn 
twist, D on 5, at the vertex v, if there is an isomorphism a : F n — > iri(Q,v) 
and a (i £ $ such that the following diagram commutes, 

F n +TTl(G,v) 

D v 

F n ^7Tl(g,v). 

Note that tt\(Q,v) and iri(Q,w) are conjugate in n(C/) and that under this 
ismorphism, D v and D w define the same outer automorphism. Hence we may 
refer to the outer automorphism induced by D. In particular, if $ is represented 
at the vertex v, then it will also be represented at every other vertex, with 
different choices of <j> G $ . 

Now it is clear that if $ is represented by a Dehn twist D, then and D 
will have the same index, in fact they will also have the same rank (as outer 
automorphisms). In [3], Corollary 7.7 it is shown that every Dehn twist has 
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maximal index and no attracting fixed infinite words. Since this is our definition 
of maximal rank, it follows that if is represented by a Dehn Twist then it 
has maximal rank. We now prove the converse. 

Theorem 5.2 Let $ € Out(F n ), n > 2 have maximal rank. Then <I> is 
represented by a Dehn twist. 

Proof Start with a relative train track map representative, /, G, of of min- 
imal complexity satisfying the conclusion to Theorem 4.11. Form a graph X 
from G by deleting all fixed edge loops. Thus X is a connected subgraph of G 
on the same vertex set as G. 

We now define a graph of groups Q with graph T(Q) = X . For each vertex 
v , let G v = Fix 7Ti(/, v) and let each edge group G e be infinite cyclic with 
generator a e . Now each edge, e, of T(Q) = X is also an edge of G so we can 
determine the path /(e) in G. By definition of X, e is not a fixed edge loop 
and so, by Proposition 4.2 and Theorem 4.11, up to orientation there is an INP 
e/3 e e and /(e) = e(3T e for some integer r e and a (3 e which is a closed INP at the 
endpoint r(e) of e. We can then define a monomorphism m e : G e — > G T ( e ) by 
mapping a e to /3 e . Similarly, f s : G g = G e — > G rg will map a e to e/3 e e. This 
completes the definition for £ . 

Given an edge e as above, set the twistor z e = a e Ve . (Recall that /(e) = e/3 e re .) 
Since G e is abelian this clearly lies in the centre. Then with z e = a e ~ re we let 
V be the Dehn twist based on these twistors. 

It should be noted that if e has height k in G, with respect to the stratification 
then there is a unique INP of height k and since /, G has minimal complexity 
this INP will be closed and of the form given by Proposition 4.2. Thus the 
definition of the maps m e for the graph of groups and the Dehn twist, V is 
unambiguous. 

Now let n(G) denote the free group on the (unoriented) edge set of G (so e 
and e are considered inverse). Let a map an edge e of G to the corresponding 
stable letter t e of H(Q) if e is not a fixed edge loop. If e is a fixed edge loop 
at v, let a(e) be the corresponding element of G v = Fix 7Ti(/, v). Since 11(G) 
is free, a extends to a unique homomorphism from 11(G) to W{Q) ■ We claim 
that this is an isomorphism. 

One can easily define the inverse, a' from U(G) to 11(G). Simply let cr'(t e ) = e 
for every stciblc letter t e ctnd. for each, v G Gy — Fix 7Ti (/, v) , let cr'(r) be the 
unique product of INP's representing it. We can extend o' to a well defined 

Algebraic & Qeometric Topology, Volume 2 (2002) 



918 



Armando Martino 



homomorphism after an easy check to show that the relations in H(Q) are in the 
kernel of a' . It is then a matter of computation to show that the composition 
(in either order) of a and a' is the identity, by just checking on generating sets. 
Thus a is an isomorphism as claimed. 

Now as / maps edges to edge paths, it induces an endomorphism /* on n(G) . 
One can easily verify that the following diagram commutes, 



n(G) 



■n@) 

D 



The map D is the Dehn twist defined above. Note that /* is actually an auto- 
morphism of n(G) and one can prove this either by induction on the number 
of strata in G or by observing the above diagram. 

With this point of view, ni(G, v) is actually a subgroup of 11(G) and 7Ti(/, v) is 
the restriction of /* to this subgroup. Since a preserves incidence relations one 
can immediately deduce that a restricts to an isomorphism between iri(G,v) 
and iti(Q,v) and thus the above commuting diagram restricts to, 



D v 



TTl(G,v) 7Tl {G i V). 

This concludes the proof of the Theorem. 



□ 



Note that in our proof we have done more than show a maximal rank outer 
automorphism a represented by a Dehn twist. We have represented the outer 
automorphism when considered as a groupoid automorphism by a naturally 
equivalent Dehn twist, also considered as a groupoid automorphism. This high- 
lights the strong connection between the two structures. 
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